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Abstract 

The multiresponse surface problem is modelled as one of multiobjective stochastic 
optimisation, and diverse solutions are proposed. Several crucial differences are 
, highlighted between this approach and others that have been proposed. Finally, in 

' a numerical example, some particular solutions are applied and described in detail. 

O ! 1 Introduction 

Many (perhaps most) real-world design problems are in fact multiobjective optimisation 
problems in which the designer seeks to optimise simultaneously several performance at- 
tributes of a design, and an improvement in one objective is often only gained at the cost 
■ of deteriorations in others, and so a trade-off is necessary. Similar situations are met in the 

^ I study of natural phenomena and in experimental trials. 

" " " Moreover, the response variables, perhaps the controllable variables and even some pa- 

rameters involved in these studies may have a random (or stochastic) character. 

A very useful statistical tool in the study of these designs, phenomena and experiments 
is that of the response surfaces methodology, in its multivariate version. This approach 
makes it possible to determine an analytical relationship between the response and control 
variables, through a process of continuous improvement and optimisation. Similarly, it 
allows us to obtain an approximate vector function (termed the multiresponse surface or 
predicted response vector) with a s maller am ount of data and fewer experim ental runs, see 



Khuri and Cornell (,1987. ), iKleiinea (,2008al ). iMvers. and Montgomervl (|2002[ ) and iKleiinen 
()2008bl) . 



Although the response variables are random and in consequence the estimated multire- 
sponse surface contains shape parameters that are estimated in the regression stage (i.e. 
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the y are rando m), the process was initially considered as one of deterministic optimisation, 



see 



BilesI (I1975I) among others. Subsequently, this randomness or uncertainty was taken into 



(|2008l ), lAmiri et all (|2008l ) and lHeiazi et al. I (|2oiol ) 



acco unt in the multiobjective optimisation process i n different ways, and at different s tages 
seelKhuri and ConlonI (Il98ll) iKhiiri and Cornelll (|l987l ) I chiao and Hamadal (|200ll ). iNan 



There exists a well-grounded and documented theory 
addresses the following general problem: 



/i2(x,0 



■Stochastic Optimisation- that 



subject to 
5,(x,O>0, J -1,2. 



(1) 



where x is fc-dimensional and £ is m-dimensional. If x or £ are ra ndom, then ([T]) defines a 
multiobjective stochastic optimisation problem, see lPrekopa I (jl995l ). As shown in the follow- 
ing sections, the optimisation of a multircsponse surface can be proposed as a multiobjective 
stochastic optimisation problem. 

In this work, the optimisation of a multiresponse surface is proposed as a multiobjective 
stochastic optimisation problem. Section [2] consider the notation and basic elements of 
the multiresponse surface. Several previous approaches made are discussed in Section [3l 
Section m proposes the optimisation of a multiresponse surface as a multiobjective stochastic 
optimisation problem and diverse solutions are proposed. Several multiobjective stochastic 
solutions are studied in detail in Section [5] Finally, a real case from the literature is analysed 
in Section ini 



2 Notation 



A deta iled discussion of multiresponse sur face methodology may be found in lKhuri and Cornell 
(Il987l . Chap. 7) and iKhuri and ConlonI (fl9 81.) . For convenience, the principal properties 
and usual notation is restated here. 

Let N be the number of experimental runs and r be the number of response variables 
which can be measured for each setting of a group of n coded variables (also termed factors) 
xi,X2, ■ ■ ■ ^Xn- We assume that the response variables can be modelled by a second order 
polynomial regression model in terms of Xj" . Hence, the fc*'' response model can be written 
as 

Yfc = + £fc (2) 

where is an x 1 vector of observations on the fc*'* response, is an A^ x p matrix of 
rank p termed the design or regression matrix, p = 1 n -\- n{n -I- l)/2, /3;. is a p x 1 vector 
of unknown constant parameters, and Sk is a random error vector associated with the fc*'' 
response. In the present case, it is assumed that Xi = • • ■ = X^ = X. Hence, ([2]) can be 
written as 

Y = XB E (3) 



where Y = 



Yi:Y2 



and E — 



ei:e2- 



such that 



B = /3i:/32:...:/3, 

E A/7Vxr(0,lAr ® S) i.e. E has an A^ x r matrix multivariate normal distribution with 
E(E) — and Cov(vecE') = Ijv (g) S, where S is a r x r positive definite matrix, where 
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if A = Ai:A2:---:Ar , then vecA — (A'j^, Aj, . . . , AJ.)' and ® denotes the direct (or 

Kronecker) product of matrices, see MuirheadI ( 1982 . Theorem 3.2.2, p. 79). In addition let 

. X = (x\^X2t ■ ■ ,Xni : The vector of controllable variables or factors. Formally, an xi 
variable is associated with each factor A, B, ... 



The least squares estimator of B given by B = (X'X) X'Y, from 



where (3f. = (X'X) ^X'Y^, fc = 1, 2, . . . , r. Moreover, under the assumption that E ~ 
7VArxr(0,lAr«)S), then B ~ A^p x r (», (X'X) ^ ^ (g) S) , with Cov(vecB') = (X'X)-i(g)S. 

z(x) = (1, , X2 7 ■ ■ • 7 7 -^l ; -^2 1 ■ • ■ 1 ■^rn ■^1^2 i ■ ■ • , Xn—lXn) • 

n(x) = z'(x)3, 

n n n n 

= f^ok + ^ f3tkXi + ^ kkxf + ^ ^ PijkXtXj : 

i—l i—1 i—1 j>i 

The response surface or predictor equation at the point x for the k*'' response variable. 



Y(x) — (^Yi(x), l2(x), . . . , Fr(x) j = B'z(x): The multiresponse surface or predicted 
response vector at the point x. 



Y'(lAr ~X(X'X)-iX')Y 



The estimator of the variance-covariance matrix S such 



N -p 

that {N — p)S has a Wishart distribution with {N — p) degrees of freedom and the 
parameter S; this fact is denoted as [N — p)S ^ WriN — p, S). Here, I,„ denotes an 
identity matrix of order m. 

Finally, note that 

£;(Y(x)) = E(R'z{x.)) = B'z(x) (4) 

and 

Cov(Y(x)) =z'(x)(X'X)-iz(x)S. (5) 
An unbiased estimator of Cov(Y(x)) is given by 



Cot(Y(x)) = z'(x)(X'X)-iz(x)E. 



(6) 



3 Multiresponse optimisation 



In the following sections, we make use of multiresponse optimisation and multiobjective 
(or more general multicriteria) optimisation. For convenience, the concepts and notation 
required are listed below in terms of the estimated model of i nultiresponse surfa c e opt i- 
misation. Definitions an d detailed p r opert i es may be found in Khuri and Conlon^ (*1 98ll) 



Khuri and Cornell 



and lPrekopal (|1995D 



19871 ). iRi'os e^ al\ (|l989l ). ISteueij (|l986[ ). lMiettinen| (|l999), Vaida (197 



The multiresponse optimisation (MRO) problem in general is proposed as 



min Y(x) = min 



/ n(x) \ 

?2(X) 



(7) 



subject to 
X g X, 
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which is a determ inis tic nonlinear mu ltiobjective optimisation problem, see ISteuen (|l986r ) 



Ri'os et al. ( 1989[ ) and MiettinenI ( 1999t ): and where X denotes the experimental region, which 



in general is defined as a hypercube 

X — {x|/i < Xi < Ui, i — 1,2, ... , n}, 

where 1 = {li,l2, ■ ■ . , In)' , defines the vector of lower bounds of factors and u — (ui, U2, • • ■ , 
define the vector of upper bounds of factors. Alternatively, the experimental region is defined 
as a hypersphere 

X= {x|x'x <c^,c€ SR}, 



where, in general c is determined by the experimental design model used, see lKhuri and Cornell 
( 19871 ). Alternatively ([7]) can be written as 



min Y(x) 

xe3E 

In the response surface methodology context, observe that in multiobjective optimisation 
problems, there rarely exists a point x* which is considered as an optimum, i.e. few cases 
satisfy the requirement that yfe(x) is minimum for all k — 1,2, ... ,r. From the viewpoint 
of multiobjective optimisation, this justifies the following notion of the Pareto point, which 
is more weakly defined than is an optimum point: 

We say that Y*(x) is a Pareto point o/ Y(x), if there is no other point 
Yi(x) such that Yi(x) < Y*(x), i.e. for all k, Y^{x.) < Y*{x.) and 
Yi(x) Y*(x). 

Existence criteria for Pareto points in a multiobjective optimisation problem and the exten- 
si on of s calar optimi sation ( Kuhn- Tucker's conditions) to the vectorial case are established 
in lSteue r (1986), Rio s et al\ (jH)89,) and .Miettincn (1999). 

Methods for solving a multiobjective optimisation problem are based on the information 
possessed about a particular problem. There are three possibl e scenarios: when t he investi- 
gator poss esses either co mplete, partial or null information, see Rios et al. i 19891) . Miettinen 



(|1999[ ) and lSteueij (|l98fih . In a response surface methodology context, complete information 



means that the investigator understands the population in such a way that it is possible to 
propose a value function reflecting the importance of each response variable, where 

The value function is a function f : 3R" 5R such that minY(x*) < 
minY(xi) ^ /(Y(x*)) < /(Y(xi)), x* ^ Xi. 

In partial information, the investigator knows the main response variable of the study very 
well and this is sufficient support for the research. Finally, under null information, the 
researcher only possesses information about the estimators of the response surface parameter, 
and with this material an appropriate solution can be found too. 

As can be observed, all the approaches proposed in the literature are particular cases 
of the models studied in multiobjective optimisation, and in particular of the e-constraint 
model and the value function model or a combination of the two. Accordingly, the equivalent 
nonlinear scalar optimisation problem of ([7]) is of the form 

min 



. /(y(x)) 

subject to (8) 



X e xn 6, 

where 6 is a subset generated by additional potential constraints, which derive from the 
particular technique used for establishing the equivalent deterministic scalar optimisation 
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problem ([5]). In some particular cases of a new fixed parameter may appear, such 
as a w = {wi, W2, ■ ■ ■ , Wr)' , vector of response weights and/or r = (ti, T2, . . . , r^)', vector 
of target values for the response vector. Particular exampl es of this equivalen t univ ariate 
objective optimisation are th e use of goal programming, see iKazemzadeh et al. ( 20081 ). and 
of the e-constraint model, see iBiled (|l975l) . among many others. 

When uncertainty is assumed in an MRO problem, in other words, when the MRO 
prob l em is c onsidered as a stochastic pr o gram, differe i it app r oaches have been proposed , see 
NmI (l2008l). IChiao and Hamadal (|200lh . lAmiri et al\ (|2008[ ). iKhuri and ConlonI (|l98l[ ) and 
Khuri and CornelT i 1987 ). In particular some of these approaches can be established as 



mm / (y(x) 
subject to 

X G xne 



(9) 



'AC 



pxr' 



,(X'X)- 



where B and S are independent. 

In addition, it is sometimes assumed that w and/or r are stochastic, and diverse strate- 
gies have been proposed t o obtain particular value s for these, includ i ng Gr oup Decision 
Making, among others, see Khuri and Conlon (Il98ll) and iHeiazi et al. I (|2010l ) . 

In general terms, thus, the MRO problem under uncertainty has been addressed as 
follows: 

1. It is considered as a deterministic multiobjective optimisation problem ([7]). 

2. An equivalent deterministic univariate optimisation problem, such as goal program- 
ming, is proposed ([5]). 

3. In the equivalent deterministic univariate optimisation problem, uncertainty is as- 
sumed 



4 Proposed approach 



In the univariate case, iDfaz-Garcfa et al. ( 2005 ) considered the problem as a stochastic 
optimisation program. The approach proposed in the present paper consists in extending 
this idea to multiresponse optimisation. Specifically, we propose the MRO as the following 
nonlinear multiobjective stochastic optimisation problem from the beginning: 



min Y 



(x,b) 



subject to 
x G X 



(10) 



pxr' 



, (X'X)-i 

WriN 



where Y(x,B) = Y(x) and Yfc(x,/3;,,) = Yfc(x). 

The solution of (jlOp can be applied to any model (technique, method or solution) under 
multiobjective stochastic optimisati on, whi c h in g e neral, is a multidimension al ex tension of 
stocha stic optimisation models, see Vaida (1972), iDiaz-Garcia et al. (I2OO5I) and iPrekopa 
()l995l ). 
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4.1 Multiobjective stochastic optimisation approaches 

In this subsection we propose (fTU)) under diverse multiobjective stochastic optimisation ap- 
proaches. The pro perties of the so l ution obtained under th e di fferent approach es are de- 
scribed in detail bv lKataokal (|l963l) . IStancu-MinasianI (|l984t) and lPrekopal (|l995[) . 

As shown below, each multiobjective stochastic optimisation approach can be proposed 
in several ways. In some cases, this possibility is a consequence of assuming that the response 
variables are correlated or not. 



4.1.1 Multiobjective expected value solution, multiobjective E- model 



Point X S X is the expected value solution to ([TU| if it is an efficient solution in the Pareto 
sense to the following deterministic multiobjective optimisation problem 



mm E 

x6X 



(11) 



4.1.2 Multiobjective minimum variance solution, multiobjective V-model 

The X g X point is the minimum variance solution to problem (jlOp if it is an efficient solution 
in the Pareto sense of the deterministic multiobjective optimisation problem 



mm 



( Var('fi(x)) \ 
Var (r2(x) 



V 



Var y;.(x) 



(12) 



This efficient solution is adequate if it is assumed that the response variables are Uncorre- 
lated. However, if the response variables are assumed to be correlated a better one is: 



min Gov ( Y ( x. 



(13) 



4.1.3 Multiobjective expected value standard deviation solution, multiobjec- 
tive modified E-model 



Point X G X is an expected value standard deviation solution to the problem (1101) if it is 
an efficient solution in the Pareto sense of the mixed deterministic multiobjective-matrix 
optimisation problem 



mm 

xG3e 



E 

Gov (y (x, ] 



1/2 



(14) 



where (A^/^)^ = A, see Muirhead ( 19821 Appendix) 



We now define the concept of the efficient solution of multiobjective minimum risk of 
joint aspiration level r = (ti, r2, . . . , r^)' and the efficient solution with a joint probability 
a. The two solutions are obtained by applying the multivariate versions of minimum risk 
and the Kataoka criteria, respectively, referred to in the literature as criteria of maximum 
probability or satisfying criteria, due to the fact that, as shown below, in both cases the 
crit eria to be used provide, in one way or another, "good" solutions in terms of probability, 
see Kataoka (|l963h . 
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4.1.4 Multiobjective minimum risk solution of joint aspiration level t, multi- 
objective modified P-model 

Point X G X is a minimum risk solution of joint aspiration level t to problem (jlOp if it con- 
stitutes an efficient solution in the Pareto sense of the multiobjective stochastic optimisation 
problem 

/ Pf?i(x) <Tl) \ 



mm 



P n"2(x) <T2, 



V 



(15) 



P (?,.(x) < Tr- 

It is also possible to consider the following alternative multiobjective P-model 



?2(X) < T2 

niin P 

xex : 

V ?,(x) <Tr J 



(16) 



Again, ([TB| is more adequate if the response variables are co rrelated. Howev er is 
considerably more complicated to solve than ([T5|). When r = 2, Prekopal ( 1970l) proposed 
an algorithm for a similar problem (probabilistic constrained programming), which can be 
applied to solve ([T6l) . 



4.1.5 Multiobjective Kataoka solution with probability a 

Point X G X is a multiobjective Kataoka solution with probability a (fixed) to problem (fTO 
if it is an efficient solution in the Pareto sense of the multiobjective optimisation problem 



mm T 

x,-r 



subject to 
P(?fc(x) <rfc) fc = l,2, 

X e X. 



(17) 



Alternatively (|17p can be proposed as 



mm T 

x,-r 



subject to 

/ Fl(x) < Tl \ 
y2(x) < T2 

V ?,.(x) <Tr J 

X e X, 



a 



(18) 



Note that (1171) and (1181) a re multiobjective proba bilist ic constra i ned p rogramming, see 

Charnes and Cooper (jl963l ). Stancu-MinasianI ( 19841 ) and Prekopa (Il995 ). 

Many other approaches can be used to solve (fTU)) . For example, Stancu-Minasiaii| (jl984f ) 



proposed a stochastic version of the sequential technique, termed the Lexicographic method, 
for solving (fT2|) and (|15p or direct application to ([TO)) : among many other options. 
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In all cases, observe that 

E(Y(x,i)) =Y(x,M) and Cov(y(x,b)) z'(x)(X'X)-1z(x)S, 

in general are unknown. Then, from a practical point of view, and having the final expression 
of the equivalent deterministic problem of (fTO)) . E (y ^x, B^^ and Gov ^Y ^x, B^^ should 
be replaced by their corresponding estimators 

E (y (x,i)) = Y (x,b) and Cot (y (x,b)) = z'(x)(X'X)-iz(x)S. 



5 Equivalent deterministic programs 

In this section we study several particular equivalent deterministic programs from (|13p in 
detail. 

5.1 Multiobjective y-model 

Taking into account the final comment in Section 21 our intention is to solve the matrix 
optimisation problem 



min Cov [Y [x, B j j . (19) 

For the sake of convenience, in this section we denote Cov (y ^x, ^ as Cov ^Y (x)^ . Ob- 
viously, the difficulty in expressing the problem in this way lies in defining the meaning of the 
minimum of a matrix function. The idea of minimising a matrix function, and in particular 
a matrix of variance- covariance, has been studied with respect to various areas of statistical 
theory. For example, when regression estimators are determined for a multivariate general 
linear model, this is done by minimisi ng th e deter minant or the trace of sums of squares and 
cross-products matrix of the error, see Giri ( 1977t ). Similarly, the choice or comparison of ex- 



perimental design models is done by minimising a func tion of the variance-covar i ance m atrix 
of treatment estimators, see Khuri and Cornell (Il987l) andE zai's and Druilhetl (|l997| ). 



Fortunately, it is possible to reduce the nonlinear matrix minimisation problem ()19|) to 
a univariate nonlinear minimisation problem by taking into account the following consider- 
ati ons. Obser v e tha t the procedure descri bed here is just one of various possible options, 



see 



Rios et all (|l989f) and iMiettinenI (|l999l) 



Assume that Cov (y (x)^ is a positive definite matrix for all x, denoting it as Cov (y(x)) 
0. Now, let xi and X2 be two possible values of the vector x and let B = Cov ^Y (xi^ 
Cov ^Y (x2)^ . Then we say that 



> 



Cov I 



(^Y(xi)j < Cov(^Y(x2)j ^ B < 0, (20) 

i.e. if the matrix B is a negative definite matrix. Moreover, note that Cov (y(xi)) and 
Cov^Y(x2)^, are diagonalizable. Then, let Dxi and Z)x2 be the diagonal matrixes asso- 
ciated with Cov^Y(xi)^ and Cov^Y(x2)^, respectively; with D^i = diag(Q;i, . . . , a^), 
ai > • • • > > and I?X2 = diag(7i, . . . , 7^), 71 > • • • > 7r > 0, where aj and 7^ denote 
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the eigenvalues of Gov (xi)^ 
alternatively be presented as: 



Gov 



(y(xi)) 



and Gov ^Y (x2)^ , respectively. Thus, expression can 
< C^(y (x2)) 



I.e. 



Gov (y (xi)) < (y (x2)) ^ aj ~ 7^- < 0, 

j=l,...,r 



(21) 



and Gov (xi)^ ^ Gov (^Y (^2 ) ) ; wh ich defines a weak Pareto order, see Steuei ( 19861 ). 
Rios et al\ (ll989|) and iMiettiuCTl (|l999[ ). Then from [Steuerl (|l986h . IRi'os a/.l (|l989f ) and 



MiettineJ ljiggg). there exists a function ,g : 5 — > 5R, such that 



Gov Y(xi) <Gov Y(x2)U^<? Gov Y(xi) <g Gov Y(x2) 



(22) 



where Gov ^Y (x)^ G 5 C 3fj''(''+i)/2 g^j^j 5 jg ^^jjg set of positive definite matrices. From 

(|22l) . ISteueil(|l986l ). lRios et al\ (|l989[ ) and lMiettinenl (|l999f ) prove that the non-hnear matrix 
minimisation problem (|19p is reduced in the following scalar non-linear minimisation problem 



min g \ Q,aw ( Y ( x, 



(23) 



Unfortunately or otherwise, the function g(-) is not unique. For exampl e, in other sta- 
tistical contexts we can find the following commonly used functions g(-), see iGiril (jl977l ): 

1. The trace of the matrix Gov ^Y (x)^ ; 

5(c^(y(x))) - tr(cS^(Y(x))) 

r 

= z'(x)(X'X)-iz(x)^a,,. 

3 

2. The determinant of the matrix Gov {y (x)^ ; 

5(c^(y(x))) = 



Gov [Y (x)^ 
z'(x)(X'X)-iz(x)]'-|S| 



3. The sum of all the elements of the matrix Gov (^Y(x) j ; 

r 

g(c^(Y(x))) =z'(x)(X'X)-iz(x) ^ a,,. 



4. g {Gon ^Y (x))^ = Aniax ^Gov ^Y (x)^^ ; where Amax is the maximum eigenvalue of 



the matrix Gov 



(y(x)). 



5. g I^Gov I^Y (x)^ ^ = Amin ^Cov(Y(x)) ), where Amin is the minimum eigenvalue of 
the matrix Gov ( Y (x) 
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6. g {Goy {y ^ {Cov {y ' '^here \j is the j-th eigenvalue of the matrix 

Gov {y (x)^ , among others. 



But observe that 



\j {cSv (y (x) 



!'(x)(X'X)-iz(x)s) 



= z'(x)(X'X)-iz(x)Aj (S) . 



Hence we can conclude that as a consequence of the structure of the covariance matrix 

Gov ^Y (x)^ , for all the particular definitions of the function g considered above, the scalar 

non-linear minimisation problem (j23p has a unique solution given by the solution of the 
non-linear minimisation problem 



min z'(x)(X'X) "'"z(x) 



(24) 



5.2 Multiobjective P-model 

Proceeding as in lDi'az-Garci'a et al. ( 2005 ). the equivalent multiobjective deterministic prob- 



lem to ([TOl) via the P-model ([15]) is 



mm 



n - z'(x)3i 


\/ctii 


z'(x)(X'X)-iz(x) 




T2-Z'(X)32 




z'(x)(X'X)-iz(x) 







\ 



(25) 



V ^/arr Z'(X)(X'X)-1^(X) / 



5.3 Multiobjective Kataoka model 

From lPiaz-Garcfa et all (|2005[ ). the equivalent multiobjective deterministic problem to ([1 
via the Kataoka model ([T7)) is given by 



mm 



z'(x)/3i - 






z'(x)(X'X)- 


-iz(x) 


z'(x)^ - 






z'(x)(X'X)- 


-iz(x) 


z'(x)^ - 






z'(x)(X'X)- 


-iz(x) 



(26) 



where $ denotes the distribution function of the standard Normal distribution. 

Similar equivalent multiobjective deterministic problems to ([TU]) are obtained by applying 
the other stochastic solutions described in Section 2] Note that, if each stochastic solution 
is combined with each multiobjective optimisation technique, an infinite number of possible 
solutions to (fTO)) is obtained. For example, note that the function of value /(•) may take an 
infinite number of forms. One of these particular forms is the weighting method. Under this 
approach, problem (fM)) can be restated as: 



minY^Wk + ^~\S) ^dkk z'(x)(X'X)-iz(x)} 



(27) 
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such that X]fe=i ^fe — 1' '^k > V fc = l,2,...,r: where Wk weights the importance of 
each characteristic. The solution x S X of (|27p can be termed the multiobjective Kataoka 
solution with probability a to problem (1101) . via the weighting method. 

Similarly, x € X is the multiobjective Kataoka solution with probability a to the problem 
pU)) . via goal programming if x G X is 



k=l 

subject to 



(28) 



z'(x)/3fc + $-1(5) ^akk z'(x)(X'X)-iz(x) -d+ ^Tk, k = 1, 2, 



where 



d+ = \ (|z'(x)^. + $-1(5) V^fefe Z'(X)(X'X)-1Z(X) - Tfc 

+ (z'(x)^ + $-1(5) Vi^fcfc z'(x)(X'X)-iz(x) 



d- - i (|2'(X);3;. + $-1(5) V^fcfc Z'(X)(X'X)-1Z(X) - Tfc 

-(z'(x)^ + $-i(5) V'^fefe ^'(x)(X'X)-iz(x)-Tfc)) . 

6 Application 

A real case from the literature is analysed by applying several approaches and particular 
solutions from multiobjective stochastic optimisatio n. 



In the following example, taken f rom I P i gnat ielld (|1993[ ). there are two response variables 
Y — (Yi,l2)' with 4 replicates and three setting variables x = (zi, 2:2, X3)'. The exper- 
imental data are shown in Table [TJ It is assumed that the targets of the responses are 
T = (ri,T2)' = (103,73)'. 



Table 1: Experimental data for the numerical example. 



Replicate 


1 


2 


3 


4 


1 


2 


3 


4 


ID 




X2 






Y2 


8 


1 


1 


1 


104.45 


105.03 


99.79 


104.92 


76.90 


77.03 


67.99 


75.77 


4 


1 


1 


-1 


104.12 


104.80 


104.20 


104.34 


72.99 


74.25 


73.94 


73.28 


6 


1 


-1 


1 


98.73 


99.36 


102.84 


94.24 


67.10 


63.61 


68.65 


62.42 


2 


1 


-1 


-1 


100.19 


99.63 


100.27 


100.60 


67.03 


66.18 


66.58 


67.94 


7 


-1 


1 


1 


103.15 


106.96 


107.62 


103.44 


71.68 


76.27 


77.50 


76.37 


3 


-1 


1 


-1 


106.08 


105.64 


105.67 


105.39 


72.94 


72.85 


72.58 


72.38 


5 


-1 


-1 


1 


113.52 


111.12 


112.85 


106.67 


68.29 


68.47 


68.96 


64.71 


1 


-1 


-1 


-1 


109.90 


109.76 


110.70 


109.77 


67.70 


67.24 


67.96 


66.93 



Equations (1^^ and ([50)1 are response surfaces for Yi and Y2. 

ri(x) = 104.86 - 3.147x1 - 0.142x2 - 0.199x3 + 2.3792:1x2 

-0.35x1X3 - 0.106x2X3 (29) 

i>2(x) = 70.45 - 0.348x1 + 3.59x2 + 0.28x3 + 0.323x1X2 

-0.45x1X3 + 0.614x2X3 (30) 

From which the multiresponse optimisation problem is given as 

min Y(x) = min ( ^^^'^^ | (31) 
xex ^ ' xex I r2(x) / ^ ' 
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where X = {x\xi G [—1, 1], i = 1,2, 3}. 

Now, assume that the importance of each response variable must be assessed from the 
decision makers' viewpoint. For the purposes of this example, consider w = (u'i,W2)' = 
(0.285,0.715)'. 



From dMD and ^ 



' 3i ' 




. 32 . 





/3o 
104.86 
70.45 



Also, 



From where 



-3.147 
'0.348 



f^2 

-0.142 
3.59 



/33 fil2 

-0.199 2.379 
0.28 0.323 



-0.35 -0.106 
-0.45 0.614 



4.190 3.546 
3.546 4.666 



Cov(vecB) 



S«)(X'X)-i 

4.190 3.546 
3.546 4.666 



0.03125 I7. 



In particular, Cov{(3i) = 0.131 I7 and Cov(/32) = 0.145 I7. Therefore, the estimator of the 
covariance matrix of response surfaces according to equation ([5]) is 



Cov(Y(x)) ^ {l+xl+xl+xl+ x\x\ -\- x\x\ -1- x\x^^ 



0.131 0.111 
0.111 0.145 



mm 



Next, we propose diverse multiobjective stochastic solutions and their deterministic equiv- 
alent corresponding programs: 

• Equivalent multiobjective V-model 

vTr (Fi (x, 3^) ) (Fi (x, 3^) , Y2 (x, 3^ 

(fi (x, 3^) , Y2 (x, 3;;) ) vTr (x, 3^ 

And its corresponding deterministic equivalent program is 

min z'(x)(X'X)-iz(x). 

Equivalent deterministic multiobjective modified E-model 

Yfx, 



where 



mm 



Y X 



{C^v (y (x, 



1/2 




and 



(c^(y (x,b))) 



1/2 



Va^(yi(x,3^)) C^(yi(x,3l),f2(x,3^)) 

cS^(yi(x,3^),?2(x,3^)) v^(f2(x,3;)) 



1/2 
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In this case the deterministic equivalent program can be stated as (among many other 
options, including lexicographic or e-constraint models) 

1/2 



min n / ( Y (x, i) ) + r2 g f (c^ ( Y (x, 



where rj > 0, j = 1,2 are constants such that ri + r2 — 1 (in general), whose values 
indicate the relative importance of the expectation and matrix covariance ofY(x,i), 
and / and g are value functions. 

In particular, using (I24[) . a deterministic equivalent program via the weighting method 
is ^ ^ 

min ri [wi z'(x)/3j + W2 2;'(x)/32) + ?'2 2'(x)(X'X)^"^2;(x), 

and assuming that the primary objective function is g, via the e-constraint model we 
have 

minz'(x)(X'X)-iz(x) 
subject to 

^'(X)3l = Tl 
z'{k)%=T2. 

Equivalent deterministic multiobjective P-model 

I n - z'(x)3i \ 



mm 
xe3e 



v/an z'(x)(X'X)-iz(x) 

T2 - Z'i^)d2 



V ^d22 Z'(X)(X'X)-1Z(X) / 

In this case the deterministic equivalent program via the weighting method is 

[ ri-z^(x)3i 1 , / r2-z'(x)32 1 

mm wi < } + W2 ' ^ 



-e^ [ ^dn 2'(x)(X'X)-iz(x) J [ ^d22 z'(x)(X'X)-iz(x) J 

And assuming that 1^2 ^x, /32^ is the primary objective function, the deterministic 
equivalent program via the e-constraint method is 

T2 - Z'{^)A 



^^22 z'(x)(X'X)-lz(x) 

subject to 
n - z'(x)3i 



Van z'(x)(X'X)-iz(x 
Equivalent deterministic multiobjective Kataoka model 



^.^ / z'(x)/3i + *-i(5) z^(x)(X^X)-iz(x) \ 

xex ^ z'(x)/32 + *-i(5) Vi522 z'(x)(X'X)-iz(x) ) ■ 

The deterministic equivalent program via the weighting method is 

min wi Iz'(x);3^ + *"\(5) Jdu z'(x)(X'X)-iz(x)| 

+ «;2 {^'(x)^ ^-\5) V?22 z'(x)(X'X)-i0(x)} 
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Now assuming that Y2 ^x, /Sj^ is the primary objective function, the deterministic 
equivalent program via the e-constraint method is 



min z'(x)/32 + *"'(<5) ^^22 2'(x)(X'X)-iz(x) 
subject to 



z'(x)/3i + ^-\S) ^an z'(x)(X'X)-i^(x) = n. 

Table [5] shows the solution of (O by diverse multiobjective stochastic methods and other 
methods described in the literature. 
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Table 2: Comparison of the results of the proposed model and those derived by other methods. 





Stochastic 
























programming 


Xi 


X2 




F 




?i(x) 


?2(x) 


Var(yi(x)) 


Var(?2(x)) 


Cov(yi(x),y2(x)) 




method 




















Chiao and Hamada (2001) 




1.000 


1.000 


-1.000 






104.612 


73.574 


0.917 


1.021 


0.776 




Distance Based 


0.953 


0.709 


0.407 




- 


103.247 


73.000 


0.428 


0.476 


0.362 




Robust E-model 


1.000 


0.707 


0.483 








Yo.UUU 


0.470 


0.523 


0.397 


Heiazi et al. {'2010^^ 


Lexicographic 
(First E{ F(x))) 


1.000 


0.707 


0.483 






103.000 


73.000 


0.470 


0.523 


0.397 




Lexicofraphic 
(First Va^(F(x))) 


0.000 


0.000 


0.000 






104.865 


70.453 


0.131 


0.146 


0.111 




IVXOUllietJ. V — lllOUtil 


000 


000 


000 








70 453 


131 


146 


111 




V-model 


0.000 


0.000 


0.000 




1 


104.865 


70.453 


0.131 


0.146 


0.111 




Modified E-model_^ 
(Weighting method) 


0.522 


-1.000 


0.108 


39 


588 


102.100 


66.449 


0.336 


0.375 


0.285 


Multiobjective 


Modified E-model 
(e-constraint) 


1.000 


0.707 


0.452 


3 


511 


103.019 


72.992 


0.460 


0.512 


0.389 


Stochastic 


P-model 
(AVeighting method) 


-0.349 


1.000 


0.548 


-2 


672 


104.893 


74.630 


0.377 


0.420 


0.320 


approaches 


P-model 
(e-constraint) 


0.910 


-0.658 


0.000 


8 


799 


100.672 


67.577 


0.343 


0.382 


0.290 




Kataoka*^ 
(Weighting method) 


1.000 


-1.000 


1.000 


74 


989 


99.039 


65.405 


0.917 


1.021 


0.776 




Kataoka 
(e-constraint) 


0.541 


-1.000 


0.851 


67 


296 


101.780 


66.006 


0.556 


0.619 


0.470 




Goal Programming 


0.844 


0.605 


1 







102.78 


72.78 


0.6764 


0.6441 


0.4895 



Objective function 
^Squared euelidean distance 

''Where weights w are considered deterministic 

ri = 7-2 = 0.5 
'^S = 0.95 



Note that while all of these optimisation techniques essentially provide the solution to 
the same practical problem, i.e. that of obtaining the critical value of the variables x, 
from a mathematical point of view and more precisely from the st andp oint of mathematica l 
programming, problem © as solved bv lChiao and Hamada ( 2001 ) and Heiazi et al. ( 2010l) 
and problem (jlOp examined in the present paper are not the same. Therefore, unless a 
reasonable basis for comparison is proposed. Table 2 should be taken simply as an example 
of different approaches and different solutions to the practical problem. From the latter, 
experts, researchers or decision makers can select the most suitable method for solving their 
own problem in terms of the particular context. 



Conclusions 

It should be emphasised that even a comparison between the diverse techniques proposed 
in this paper should be made with appropriate reservations, since the solutions discussed 
refer to different decision-making criteria. For example. Table [5] shows that the methods 
designed to minimise the variance actually obtain a lower variance than the other solutions, 
but perhaps the optimum response variables are a little further from the target. Likewise, 
the minimum risk models provide more conservative solutions. 
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